← All datasets

Metagenomics

EMG produced TPA metagenomics assembly of the A metagenome-wide association study of gut microbiota in type 2 diabetes. (gut metagenome) data set.

Gut microbiome data from a study of type 2 diabetes, reassembled and annotated by MGnify. The benchmark uses InterPro functional-abundance profiles of the microbial community to predict recorded host sex.

Binary classificationLicence: PublicMGYS00005285Target: host sexmgnify ↗

Mean cross-validation scores for this dataset. Each score comes from the requested feature- and sample-cap cell, and failed fits use the constant predictor.

At this operating point

Model comparison

p=10,000, n=100 · Higher Macro-F1 is better

Random Forest is marked with a diamond. Models are ordered by the selected metric.

Across sample budgets

Learning curves

All metric values at this operating point
ModelMacro-F1MCCBalanced accuracyROC-AUC
AutoGluon0.51560.063040.52850.5112
TabDPT †0.50780.04980.51990.5181
Logistic Regression0.49370.0049890.50120.4869
TabFM0.48750.0380.51430.4916
MLP0.4842-0.014120.4930.5068
RealTabPFN 2.50.4812-0.019830.48860.5063
XGBoost0.4798-0.022770.49190.5083
MITRA0.46320.026050.50970.4861
KNN0.4631-0.064760.46860.4315
LightGBM0.4536-0.0016360.48590.4848
RealMLP0.4457-0.06590.4690.4811
RealTabPFN v20.4438-0.021790.4910.4843
Random Forest0.4355-0.080290.46810.4597
Extra Trees0.4339-0.070030.47040.4614
TabM0.4323-0.076640.45630.4533
CatBoost0.4102-0.16260.42590.4346
TabPFN Wide (8k) ‡0.3831-0.031170.49380.4718
TabPFN 30.37770.026290.50290.4712
TabICL v20.371600.50.5
TabPFN Wide 5k (ne3) ‡0.371600.50.4572